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CENTRAL LIMIT THEOREM FOR SIGNAL-TO-INTERFERENCE 
RATIO OF REDUCED RANK LINEAR RECEIVER 

By G. M. Pan 1 and W. Zhou 2 

EURANDOM and National University of Singapore 

Let s fe = -L.(vik,- ■ ■ ,v N k) T , with {v ik ,i,k = 1, . . .} independent 
and identically distributed complex random variables. Write Sk = 
(si,...,s fc _i,s fc+ i,...,s K ), Pfe = diag(pi,...,p fe _i,p fc+ i,...,p K ), 
R fc = (S fc P fc S; + o 2 \) and A fcm = [s fc , R fc s fc , . . . , R™ _1 s fe ]. Define 
Pkm = PkslA km {A* km x RfcAfc m ) -1 A£ m Sfc, referred to as the signal- 
to-interference ratio (SIR) of user k under the multistage Wiener 
(MSW) receiver in a wireless communication system. It is proved 
that the output SIR under the MSW and the mutual information 
statistic under the matched filter (MF) are both asymptotic Gaus- 
sian when N/ K — > c > 0. Moreover, we provide a central limit the- 
orem for linear spectral statistics of eigenvalues and eigenvectors of 
sample covariance matrices, which is a supplement of Theorem 2 in 
Bai, Miao and Pan [Ann. Probab. 35 (2007) 1532-1572]. And we also 
improve Theorem 1.1 in Bai and Silverstein [Ann. Probab. 32 (2004) 
553-605]. 

1. Introduction. 

1.1. The signal-to-interference ratio (SIR) in engineering. Consider a 
synchronous direct-sequence code-division multiple-access (CDMA) system. 
Suppose that there are K users and that the dimension of the signature 
sequence assigned to user k is N. Let x^ denote the symbol transmitted 
by user k, the power of user k and n G noise vector with mean zero and 
covariance matrix <r 2 I. Suppose that independent random variables 

(r.v.'s) with Exk = and Exi = 1 and that x' k s are independent of n. The 
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discrete time model for the received vector r is 

K 

(1.1) r=^2^/nx k s k + n. 

k=l 

The goal in wireless communication is to estimate the transmitted x k for 
each user in an appropriate receiver. For simplicity, in the sequel we are only 
interested in linear receivers. A linear receiver, represented by a vector c^, 
estimates x k in a form c* k r (the notation * denotes the complex conjugate 
transpose of a vector or matrix). The well known linear mean-square error 
(MMSE) minimizes 

(1.2) E\x k -c* k r\ 2 . 

To evaluate the linear receivers, a popular performance measure is the 
output signal-to- interference ratio (SIR), 

(13) Pk(c* k s k ) 2 

(see Verdii [19] or Tse and Hanly [16]). Ideally, a good receiver should have 
a higher SIR. 

Without loss of generality we focus only user 1. For MMSE receiver, from 
(1.2) one can solve ci = RT^si and then substitute ci into (1.3) to obtain 
the SIR expression for user 1 as 

(1.4) p 1 =p 1 s* 1 -R^ 1 Sll 

where Ri = (S1P1S* +cr 2 I), Si = (s 2 , . . -,s K ) and Pi = diag(p 2 , • • • ,Pk)- It 
turns out that the choice of ci also maximizes user l's SIR. But since MMSE 
involves a matrix inverse this may be very costly when the spreading factor 
is high. Based on this reason, some simple and near MMSE performance 
receivers like reduced-rank linear receiver have been considered. 

The basic idea behind a reduced rank is to project the received vector 
onto a lower dimensional subspace. For the multistage Wiener (MSW), the 
lower dimensional subspace has been described as a set of recursions by 
Goldstein, Reed and Scharf [7] and Honig and Xiao [10]. However, we would 
like to make use of another property of MSW given in Theorem 2 in Honig 
and Xiao [10] for our purpose, that is, MSW receiver estimates x\ through 
MMSE after producing m-dimensional project vector Ai m r instead of r, 
where m <n and 

(1.5) A lm = [s 1 ,R 1 si,...,R^ 1 s 1 ]. 

Similar to (1.4), one can get c\ m = (A* m Ri Ai m ) -1 AJ m Si and the output 
SIR 



(1.6) Pim =PisJAi m (A5; m RiAi rn ) ^^si, 
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which is the focus of this paper. 

The MSW, as a kind of reduced-rank receiver, was first introduced by 
Goldstein, Reed and Scharf [7]. The receiver is widely employed in practice 
because the number of stages m needed to achieve a target SIR, unlike 
other reduced-rank receivers, does not scale with the system size, that is, 
dimensionality N of the system, as remarked by Honig and Xiao [10]. In 
their subsequent newsletter [11], the authors specially addressed this point. 
In addition, Honig and Xiao [10] showed that the SIR of MSW converges to a 
deterministic limit in a large system. However, as we know, in a finite system, 
the SIR will fluctuate around the limit. Moreover, such fluctuation will lead 
to some important performance measures, such as error probability and 
outrage probability. Regarding this promising receiver, we will characterize 
such fluctuation by providing central limit theorems in this paper. 

From now on the signature sequences are modeled as random vectors, 
that is, 

Sfc = -7=(vik,---,VNk) T , 

k = 1, . . . , K, where {vn~,i, k = 1, . . .} are independent and identically dis- 
tributed (i.i.d.) r.v.'s. Then the SIRs (1.6) may be further analyzed using 
the random matrices theory when K and N go to infinity with their ratio 
being a positive constant, which is well known as the large system analysis 
in the wireless communication field. 

Tse and Hanly [16] and Verdu and Shamai [20] derived, respectively, the 
large system SIR and spectral efficiency under MMSE, Matched filter (MF) 
and decorrelator receiver. Tse and Zeitouni [17] proved that the distribution 
of SIR under MMSE is asymptotically Gaussian. Later, Bai and Silverstein 
[4] reported the asymptotic SIR under MMSE for a general model. For more 
progress in this area, one may see the review paper of Tulino and Verdu 
[18] and, in addition, refer to the review paper of Bai [2] concerning ran- 
dom matrices theory. Here we would also like to say a few words about our 
earlier work (Pan, Guo and Zhou [12]). In that paper, the random variables 
are assumed to be real and we could apply central limit theorems which 
have appeared in the literature. For example, we made use of main results 
from Gotze and Tikhomirov ([8], page 426: considering real random variables 
with the sixth moment) and Bai and Silverstein [3] (requiring Evfi = 3 or 
-E'l^nl 4 = 2). In the present work we develop a central limit theorem for 
the statistic of eigenvalues and eigenvectors under the finite fourth moment 
(see Theorem 1.3), which further gives a central limit theorem for a ran- 
dom quadratic form (see Remark 1.5). And we give a central limit theorem 
(see Theorem 1.4) for eigenvalues by dropping the assumption Evfi = 3 or 
-^|^n| 4 = 2 in Bai and Silverstein [3]. For central limit theorems in other 
matrix models, we refer to [1]. 



4 



G. M. PAN AND W. ZHOU 



Our main contribution to engineering is to prove that the distribution of 
the SIR under MSW, after scaling, is asymptotic Gaussian and that the sum 
of the SIRs for all users under MF (m = 1), after subtracting a proper value, 
has a Gaussian limit, which further gives the asymptotic distribution of the 
sum mutual information under MF. 

We introduce some notation before stating our results. Set R= (C + cr 2 I), 
C = SPS*, S = (si, . . . ,sk) and P = diag(pi, . . . ,pk)- Suppose that F c ' H (x) 
and H(x), respectively, denote the weak limit of the empirical spectral dis- 
tribution function F CnSFS * and Hn (i-e., F F ), where cn = N/K. In particu- 
lar, F c ' H (x) becomes F c (x) when P is the identity matrix, whose probability 
density was given in Jonsson [6]. Let W°(t) denote a Brownian bridge and 
X is independent of W°(t), which is N(Q,Ev\i — 1). Furthermore, let 

W^ = W°(F c (x)), 

c* = ± (; ) i° 2 r u (kx + V2c- d wi) , 

i = 1, . . . , 2m — 1, and Co = X, with h u = J x u dF c (cx). Define a m = J(x + 
o 2 ) m dF CN ' HN {cx) and 









/ ai 


a 2 




b = (l,oi,. 




B = 




a 3 












a m+l 





where F c ^'^(x) = F c > h {x)\ c=CN)H =h n - 

In what follows, with a slight abuse of notation, we still use a m as a limit, 
such as (1.8) below, even when F Cn,Hn (x) is replaced by F C,H (x) in the 
expression of a rn . 



Theorem 1.1. Suppose that: 

(a) {vij,i,j = 1,...,} are i.i.d. complex r.v.'s with Ev\\ = 0, Fv\± = ; 
-E^iil 2 = 1 and E\vu\^ < oo. 

(b) cat — > c> as N — > oo. 

(c) pi = ■ ■ ■ =pk = 1- Then, for any finite integer m, 

(1.7) VN((3 lm -b*B- l b)^y, 
where 

(1.8) y = 2C*B~ 1 b-b*B~ 1 DB" 1 b, 



with C = (Co, ■ • ■ ,Cm-i) and D = (t%) = (Q+j-i)- 
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Remark 1.1. It can be verified that 

Cov / x l dW£, \ atdW' 

(1.9) = / x l+3 dF c (x) 

(l+v^) 2 . /-(1+v^) 2 



x l dF c (x) / x J dF c (x). 

Moreover, X is independent of fn^^/gjz x% dW£ and so the variance of y can 
be computed, although it is complicated. 

The asymptotic distribution of the sum mutual information has been de- 
rived for MMSE by Pan, Guo and Zhou [12]. Thus, it is interesting to derive 
the corresponding asymptotic distribution of the MSW. But, unfortunately, 
it is rather complicated for the MSW case. At this stage, we can only de- 
rive the asymptotic distribution for the sum mutual information for the case 
m = 1, which is well known as the MF (see Verdu [19]). 

Obviously, when m = 1, the output SIR for the MSW, (3k m (the expres- 
sions for (3km can be derived similarly to (3i m ), becomes 



(1.10) 



Pk ~ 



with Rfc = Cfc + <7 2 I and = S^P^St, where and are respectively 
obtained from S and P by deleting the fcth column (here we denote (3ki by 
AO- 
Theorem 1.2. Suppose that: 

(a) {vij,i,j = 1, . . . ,} are i.i.d. complex r.w.'s. with Evu = 0, Evfi = 0, 
infill = 1 and E\vn\ 4 < oo. 

(b) The empirical distribution function of power matrixP converges weakly 
to some distribution function H(t) with all the powers bounded by some con- 
stant. 

(c) cat — > c> as N — > oo. Then 
with pi = ■ ■ • = Pk = 1) 

2E\v u \' i -3 1 
M= rTTTM9 + 



c(a 2 + l/c) 2 c 2 (<r 2 + l/c) 
and r defined in (5.34)- 
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We would like to point out that the result has been given only for the equal 
power case (pi = • • • = pk = 1) in Theorem 1.2, although the assumptions 
are concerning different powers. As will be seen, the main difficulty of the 
different powers case is that matrices (SPS*) 2 and SP 2 S* have different 
eigenvalues. But, it is worth pointing out that one may establish a central 
limit theorem for 

JV 

following a similar line of Bai and Silverstein [3], where /, g are analytical 
functions and Xj,fJ,j denote the eigenvalues of P 1 < /2 S*SP 1 / 2 and PS*SP, 
respectively. We do not intend to pursue this direction since the process is 
lengthy. 

Concerning the sum mutual information under the MF, we have the fol- 
lowing: 

Corollary 1.1. Under the conditions of Theorem 1.2, 

K 



(1.12) (log(l + (3 k ) - log(l + ^^)) N(vi,rl 

with 



k=l 



Mi 



l + tc-i+a 2 )- 1 

_ 2(E\v n | 4 - 2)(tT 1 + a 2 ) 2 + 2c~ 1 (l + c' 1 ) + a 4 + 2a 2 C - 1 

c ( c -l +fJ 2)4( 1 + ( c -l +(J 2)-l)2 



and 



T 



2 



(l + (c _1 +<7 



1.2. Random matrices. Random matrices have been used in wireless 
communication since Grant and Alexander's 1996 conference presentation 
[9] and it has proved to be a very powerful technique. To prove the preced- 
ing theorems, we develop a central limit theorem for the eigenvalues and 
eigenvectors of the sample covariance matrices, which is a supplement of 
Theorem 2 in Bai, Miao and Pan [5]. And we also improve Theorem 1.1 in 
Bai and Silverstein [3]. Obviously, these central limit theorems are interest- 
ing themselves. 

1/2 l/ 1 ? 1/2 

Let catT^ SS*T^~ = A^v with being the square root of a non- 

negative definite matrix T^r and UatAtvU^ be the spectral decomposi- 
tion of Atv, where A;v = diag(Ai, A2, • • • , \n), Uat = {u%j) is a unitary ma- 
trix consisting of the orthonormal eigenvectors of An- Suppose that xjy = 
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(x N1 , . . .,x NN ) T G C^, ||xjv|| = 1, is nonrandom and y = (yi,y 2 , ■ ■ ■ ,Vn) T = 
C/^-Xjv- Let F An denote the empirical spectral distribution (ESD) of the 
matrix A^v and F^ N (x) another ESD of A/v, that is, 

TV 

(1.13) F 1 A -(x)=^|y l | 2 /(A l <x). 

i=i 

Let 

G N (x) = Vn(F An (x) - F Cn ' Hn (x)), 

and m(z) = m F c.H (z) denote the Stieltjes transform of the limiting empirical 
distribution function of cjvS*TVS. Now it is time to state the following 
theorem. 



Theorem 1.3. Assume: 

(1) Vij, i,j = 1, 2, . . . , are i.i.d. with Evn = 0, E\vn\ 2 = 1 and E\vii\ A < 
oo, and limjv->oo c/V = c G (0, oo). 

(2) XjvG{xG C^, || x ||=1}. 

(3) Tjv is nonrandom Hermitian nonnegative definite such that its spec- 
tral norm is bounded in N, H N = F Tn ^ H, a proper distribution function 
and x^(T — z/) xjv — ► m F H(z), where m F H(z) denotes the Stieltjes trans- 
form of H{t). 

(4) gi , . . . , gk are defined and analytic on an open region V of the complex 
plane, which contains the real interval 



(1.14) 



liminf a£&J (0 i)(c)(l - ^) 2 ,hmsupA^ x (l + V^Y 



N 



N 



where A m -^ and A^ x denote, respectively, the minimum and maximum eigen- 
values of Tjy • 



(5) 



sup v N 



x* N (m FCN ,H N {z)T N + 1) xn 



rn F c N ,H N (z)t + l 



dH N (t) 



as n — > oo . 
(6) 



max|e*T^ 2 (zm(z)T7v + zl) 1 xj^\— > 0, 



where ej is the N x 1 column vector with the ith element being 1 and the 
rest being 0. Then the following conclusions hold: 
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(a) If vu and Tjy are real, the random vector (J gi(x) dG^(x), . . . , 
J gk(x)dGN(x)) converges weakly to a Gaussian vector (X gi , . . . ,X gk ), with 
mean zero and covariance function 



Cov(X 91 ,X m ) 

(L15> =-iIl 9l<2ltefe) 



Ci Jc 2 

(z 2 m{z 2 ) - zimOl)) 5 



dz\ dz2 ■ 



c 2 z 1 z 2 (z 2 - zi){m(z 2 ) -m{zi)) 

The contours C\ and C 2 in the above equality are disjoint, both contained 
in the analytic region for the functions (gi, ■ ■ ■ ,gk) a nd both enclosing the 
support of F Cn ' Hn for all large n. 

(b) If vu is complex, with Ev\i = 0, then the conclusion (a) still holds, 
but the covariance function reduces to half of the quantity given in (1.15). 

Remark 1.2. It is under the assumption Evfi = 3 in the real case or 
E\vu | 4 = 2 in the complex case that Bai, Miao and Pan [5] obtained the 
above central limit theorem. But, when Evf^ ^ 3 in the real case, there 
exist sequences {x n } such that 



xdG^{x), J x 2 dG]v(x) 

fails to converge in distribution, as pointed out in Silverstein [13]. There- 
fore, when Evfi ^ 3 in the real case or S|t;n| 4 ^ 2 in the complex case, to 
guarantee the central limit theorem, we here impose an additional condition 
(6), which is implied by 

(1.16) max |xjvi| — > 0, 

i 

when T^r becomes a diagonal matrix. Thus, the variance is dependent on 
the fourth moment of v\\. 

Remark 1.3. Let gi{x) = x,g 2 (x) = x 2 ,.. .,gk(x) = x h . Then 

n((x* n A n x n - J xdF c "' HN (x)^j,...,(x* N A k N x N - J x k dF c "> HN (x) 

converges weakly to a Gaussian vector, which is used when proving Theorem 
1.1. 

To derive Theorem 1.2, we would like to present a central limit theorem 
for the eigenvalues, which is a little improvement of Theorem 1.1 in Bai and 
Silverstein [3]. Define 

L N (x) =N(F An (x) - F Cn ' Hn {x)). 
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Theorem 1.4. In addition to the assumptions (1), (3) and (4) in The- 
orem 1.3 [remove the assumption concerning x^(Tjv — z/) _1 xjv in (3)/, 
suppose that 

1 N 

- £ e?T# 2 (m^T* + I)^ 1 T^ /2 e 4 e*T^ /2 (m(z 2 )T^ + I)" 1 ^ 2 * 

(1.17) ^ , ^ 

-> h 1 (z 1 ,z 2 ) 

and 
(1.18) 

x T]i 2 e ie *T)l 2 (m(z)T N + I)" 2 ^ 2 e; -> h 2 {z). 

Then the following conclusions hold: 

(a) If vu and T/v are reaZ, i/ten (/ g\{x) dL^{x), . . . ,J gk(x) dL^(x)) con- 
verges weakly to a Gaussian vector (X gi X gk ) , with mean 

1 f cfm\z)t 2 dH{t)/{l+tm{z)f 
9 2m J 9{ ' (1 - cfm 2 (A 2 dH(t)/(l + tm(z)) 2 ) 2 

(1.19) 

Ev^ - 3 f cm 3 (z)h 2 (z) 

2ni J 9{Z) 1 - cfm 2 {z)t 2 dH{t)/{\ + tm(z)) 2 

and covariance function 

Cov(X gi ,X g2 ) 

= -^J J (m(z 1 ) - m{z 2 )) 2 d^ m{Zl) dz~ 2 miZ2) dZl dZ2 

(1.20) 

c(Ev\ 1 - 3) d 2 



gx{zi)g 2 {z 2 )- 



4tt 2 J J dz± dz 2 

x [m.(zi)m(z 2 )hi(zi,z 2 )]dzidz 2 . 

(b) If v\\ is complex with Ev 2 ^ = 0, then (a) holds as well, but the mean 
is now 

(1.21) EX g = - EMA ~ 2 fg(z) f 2 ; m " { ; )h2 ^ -^dz 

y ' 9 2m J v J l-cJm 2 (z)t 2 dH(t)/(l + tm(z)) 2 

and covariance function 

Cov(X gi ,X g2 ) 

1 f f 9i{zi)g 2 {z 2 ) d d . . 

= ~im\ / ( < \ T~va^~ mzi)— m{z 2 )dz 1 dz 2 

47r z J J \m\zij — rn\z 2 )Y az\ dz 2 
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(1.22) 

c(£M 4 -2) f f d 2 
gi{zi)g 2 (z 2 ) 



4-7T 2 J J dz\ dZ2 

x [lR{z 1 )m{z2)hi{z 1 , z 2 )\ dzidz 2 . 



Remark 1.4. When TV is a diagonal matrix, 

t 2 dH{t) 



h 2 (z) 



hi(z!,z 2 ) 



(m(z)t+l) 3 ' 

t 2 dH{t) 
{m{zi)t + l)(m{z 2 )t + l)' 



This indicates that the assumptions Ev^ =3 or _E|un| 4 = 2 in Bai and 
Silverstein [3] can be removed when Tjv is a diagonal matrix. When T^r = I 
and g(x) = x r , 

_L f ( \ cm 3 (z)h 2 (z) 

2ni J 9[Z> 1 - cJm 2 (z)t 2 dH(t)/(l + tm(z)) 2 



(1.23) =c 1+r E 

3=0 



r\ ( 1 — c\ J { 2r — j 



3 J \ c J \r-l 

r\ ( 1 — c V / 2r + 1 — j 



jj\cj\ r-1 



,1+ 

j=0 

and when 51 (x) = x ri and 52(2;) = £ r2 > 

c f f d 2 
~4^2 _/ J 9i(zi)g2(z 2 )j^-j^[m(z 1 )m(z 2 )h 1 (z 1 ,z 2 )]dz 1 dz 2 

(1.24) =c ^ + ig|;^iU^^- cVl+J2 

ji=0j 2 =0 



Jl/ VJ2 



/2n 




pr 2 








V r 2 





Remark 1.5. In applying Theorem 1.4 to Theorem 1.2, we take g\{x) = 
x + x 2 , that is, one needs to transform (1.11) into 

n 

+ X 2 ) + u n , 

where the term u n will be proved to converge to some constant in probability. 
Indeed, when using Theorem 1.3 or Theorem 1.4, g\{x) is usually taken to 
be a polynomial function. 
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The rest of this paper is organized as follows. The proofs of Theorem 
1.3 and Theorem 1.1 are given in Sections 2 and 3, respectively. Section 
4 includes the argument of Theorem 1.4. Section 5 establishes Theorem 
1.2, while the truncation of the underlying r.v.'s. is postponed until the 
Appendix. Section 6 establishes Corollary 1.1. Throughout this paper, to 
save notation, M may denote different constants on different occasions. 



2. Proof of Theorem 1.3. Let A(z) = A N — zl, Aj(z) = A(z) — SjS*. 
With a slight abuse of notation, here and in the argument of Theorem 1.4, 

1/2 1/2 

we use Sj to denote the jth column of S, as in Bai, Miao and Pan 

[5], but one should note that this Sj is different from one of other parts. To 
complete the proof of Theorem 1.3, according to the argument of Theorem 
2 in Bai, Miao and Pan [5] [especially (4.1), (4.5) and (4.7)], it is sufficient 
to prove that 

, K N 
A 3=1 i=l 



where Ej = E(-\Fj), F 3 = cx(si, . . . , sj) and 

U nj (z) = T^Afiz^^AjHz)^ 

Define 



A jk (z) = A(z) - sjs* - s k s* k , e k (z) = f3 jk (z)A jk 1 (z)s k s* k A jk 1 (z), 
EH nj (z) = T^EAjHz^lEAj^z)^ 2 , f3 jk (z) = 1 ■ 

' k A jk\ z )*>k 

It is observed that 

e^T^Aj 1 ^) - i?A- 1 (z 1 ))x n x;A7 1 (^)T] v /2 e 4 

= e^T^CAT 1 ^) - EAj\z 1 ))^(Aj\z 1 ) - EA~ 1 (zi))T 1 ^ 2 e i 
+ e*T]i 2 (Aj 1 (z 1 ) - J EAT 1 (z 1 ))x n x^A7 1 (z 1 )T^ /2 e, 

K 

= ]T e*T] v /2 ( J E fcl AT 1 ( 2l )-^ 1 -iA7 1 (^i))x ri 

ki,k 2 =l 

x x* n {E k ,A-\ Zl ) - £; fe2 _ 1 AT 1 (z 1 ))T^ 2 e i 

K 

+ Y, e*T]f (^feAT 1 ^) - i?nAT 1 (z 1 ))x n x;£AT 1 ( Zl ) T ; /2 e i 

k=l 
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K 



= e*T^(( J B fcl -£; fcl _ 1 ) efcl (z 1 ))x n 
x K(( E ka - E k 2 -i) £ k2 (2i))T^ 2 ei 

K 

-J2< T N 2 (( E k ~ ^ fc -i)e fc (^i))x n x^AT 1 (z 1 )T] v /2 e i . 

This, together with the Burkholder inequality and (4.4) in Bai, Miao and 
Pan [5], gives 



E 



N 



i=l 



<^^|(H rei ( Zl )-T^ 2 (£;A7 1 (^))x n x;A7 1 ( 2l )T^ 2 ) ii | 2 

i=l 

AT 

x]T£|(H ni (z 2 )y 2 

i=l 

TV 



1 2 



i=l 



e*T]{ 2 ((E kl - J E fcl _ 1 ) £fcl (z 1 ))x„ 



1/2 



1/2 



iV 



+ M^T l^EAj^z^T^e^E 



i=i 



X] e?T# 2 ((£* - J E fc _ 1 )e fc (z 1 ))x n 



<"4 + £, 



which implies 



1 



K N 



^J2J2 E j( H n j (zi)-T]i 2 (EAj 1 (z))^A-\z)T 



K 



AT Jii 



j=l i=l 



(2.2) 

x {E j H nj {z 2 )) li ^0. 
Similarly, one can also prove that 

-. K N 

1 A -1 



A' 



j=i i=i 



x (E j H ni (z 2 )) ii ^0 
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and, therefore, 



K N 



A 3=1 i=l 

Via an analogous argument, 

1 A' 

A i=i i=i 

Thus, for the proof of (2.1), it is sufficient to show that 



(2.3) 



Y,(En n i(zi))ii(Eii nl (z2))ii 



8=1 



To this end, write 



K 



Ai(«) - (-Tjv(z)) = £ s k s* k - (-zEm n (z))T N , 



k=2 



where m n (z) denotes the Stieljes transform of -^S^T^Si and Tn(z 
zEm n (z) x + zl. Using equality, similar to (2.2) of Silverstein [15], 

K 



(2.4) 
we get 



1 



k=2 



(2.5) 



= (TNiz^E ( f>s£ - (-zEm^TrAA^i; 

. \k=2 / 

(T^r'skslA^Hz) 



K 



J2 E 

k=2 



Pik(z) 



It follows that 

e*T)( 2 EAi\z)x n - e*T^ /2 (-f ^(z))- x x r 



(K - 1)E 



(2.6) 



s* 2 A^ 1 (z)^ n e*T]i 2 (T N (z))- 1 s 2 
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le*T^ /2 (f JV (z))- 1 T^i5;Ar 1 (z)x r 



P1+P2+P3, 



where 



px = {K- l)E[f3 12 (z)b 12 (z)t(z)a(z)l 

p 2 = ^—^E[p 12 (z)e*Tf(T N (z))- l T N (A^(z) - A^\z))x n ] 



and 



K 
K-l 



P3 = ^— -Elf3 12 (z)e*Tf(t ^(z))- 1 T^(Ar 1 (z) - SA^ 1 (*))*«]• 



K 

Here we also set 



= s* 2 Ar 2 1 (z)x n e:T^ /2 (T JV (z))- 1 s 2 



e*T] v /2 (T^(z))- 1 T J vAr 2 1 (^x r 



A' 



and 



-i 1 1 

a(z) = SoA 19 (z)s 2 Tr A 19 (z), &12U) = -, . 

KJ K 12V h UV ' l + tl/i^TrA^Cz) 

According to (4.2) and (4.3) in Bai, Miao and Pan [5], one can conclude that 
max | = 0(K~ 1/2 ), 

i 

max \p 2 \ = max A[/3 2 2 (z)e*T^ /2 (f ^(z))- 1 



12 1 (z)s 2 s 2 A 12 1 (z)x ri ] 



0(A- 1 ) 



and 



max I/93 1 = max 



if — 1 



K 



E[[3 l2 {z)b l2 {z)a{z)e*T^{T N {z))- 1 
xT N (A^(z)-EA^ 1 (z))^ n ] 



OiK' 1 / 2 ). 



Hence, 



max|e*T^ 2 £;A 1 ; 1 (z)x Ar | 0, 



which, together with the Holder inequality, guarantees (2.3). Thus, we are 
done. 
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3. Proof of Theorem 1.1. It is easy to show that 



s^R^si - a m ^ 0. 



It follows that 



(3.1) Sl A lm -b*^>0, Ai TO RiAi m -B-^0. 

It is then observed that 

VN((3 lm - b*B 

= VN(s* l A lm -b*)(Al m -R 1 A lm y 1 A* lm s 1 
+ ViVb*(A^ m R 1 A lm )- 1 (Al m s 1 - b) 

(3.2) 

+ v / iVb*((A* m RiAi m ) _1 - B-^b 
= 2v / iV(s^A lm -b*)B- 1 b 

-A/jNTb*B- 1 (A^RiAi m -B)B- 1 b + p(l), 
where we use (3.1), (3.6) below and an identity 

B x 1 - B 2 1 = -B 1 x (Bi - B 2 )B 2 , 
which holds for any invertible matrices Bi and B 2 . Furthermore, let 

b'B" 1 = ((*!,...,<*,»), 

then (3.2) is now equal to 

m m 

(3.3) 2v / iV^d i (s 1 Ri- 1 s 1 - a-x) - Vn £ ^(s^Ri+^S! - a i+3 ^). 

i=X i,j=l 

By the result (1) of Theorem 1.1 of Bai and Silverstein [3], it is easily seen 
that 

V^^TrRi-ai) 0. 

To derive a central limit theorem for (3.3), it then suffices to develop a 
multivariate one for {V r /V(s 1 R l 1 si - Tr K\), i = 0, . . . , 2m - 1}. 
Set Hx = SiSJ and h m = J x m dF CN (cx). Note that 



v/iVfslRis! ~ ^ TrRl ) = £ („) (<t 2 ) 1 - u Vn(sIH u iSi - ^TrH^). 

u=0 



(3.4) 
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Let ||si|| 2 = £ili \vn\ 2 /N. Write 

= ^iV|| Sl || 2 - IxrH^) + Vivl TVH«(|| Sl || 2 - 1). 

It is easy to check that 

va/y/N 



max 



Il s i|| 

Therefore, given si, it follows from Theorem 1.3 that 



V2[ / -dW£,..., / — 



dW c x 



(regarding the formula, one may refer to Bai, Miao and Pan [5] or Silverstein 
[13, 14]). However, it is evident that 

(3.5) ViV(|| Sl || 2 -l)^X, 

where X ~ N(0, E\vn\ 4 — 1). Consequently, by the independence of Sx and 
Hi, 

^(8*8! - 1), . . . , VnUh.?"- 1 ^ - 1 TrH 2 — 1 )) (£o, . . • ,6m-l), 
where & = + ^ /(w^ xW£, i = 1, . . . , 2m - 1, and £ = X. Then 
v/iVKs! - 1), ... , x/ivfstR^-^! - 1 TV R 2m " x 

(3.6) 

► (Co, • • ) C2m-l), 

where Ci = EUo 0(^) i_u e«- 
It follows that 

m m 

A/JVC9i m - t/B^b) 2^diCi - E didiCi+i-i- 
Thus, we are done. 
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4. Proof of Theorem 1.4. By the argument of Bai and Silverstein [3], it 
suffices to find the limits of the following sums: 



K N 



j=i i=i 

and 

1 N 

(4.2) -Y,E[{T% 2 A^\z)Ty i \{T% 2 Af{z){T N {z)T 1 T%\^ 

i=l 

(see (2.7) and (4.10) in Bai and Silverstein [3]). 
Similar to (2.2), it can be verified that 

-. K N 

A j=\i=\ 

x E J (T]{ 2 Aj 1 (z 2 )T]l 2 ) ll = O p {N^ 2 ). 
Consequently, analogous to Theorem 1.3, it remains to find the limit of 
1 N 

(4.3) -Y.mT^iH^ThmT^i^Tfh. 

Define 

1 (z)=slA u 1 (z)T]i 2 e l e*T]i 2 (T N (z))- 1 s k 

- le*T^ 2 (T A r^))- 1 T JV A7; fc 1 ^)Tf e,. 

Prom (2.5), we have 

EiT^A^Tf )« - e*T# 2 (-T arC*))" 1 ^ 2 e, 

if r 



fc=2 



(4.4) 

= ri(z) + r 2 (z) +r 3 (z 



/3 u .(z)e*T] v /2 -i(f J v(z 1 ))- 1 T 7 v J BAr 1 (z)T^ 2 e i 



where 

n(z) = (K - l)E[p 12 (z)b 12 (zh(z)a(z)}, 

T 2 (z) = ^^E[(i l2 {z)e*Tf(T N (z))- l T N (A^{z) - AT" 1 \z))Tf ! e,] 
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and 

rs(z) = 1 ^E[p l2 {z)e*T)l 2 {T N (z)y l T N (Al l {z) - EA^z))^^]. 
Therefore, it follows from (4.4) that 
1 N 

2=1 

where the estimate can be obtained as in Theorem 1.3. 

Regarding (4.2), due to similar reason, one need only seek the limit of 

1 N 

-^^[(T^ATH^T^^d^lCT^Aj 1 ^^^)- 1 ^ 2 )^. 

i=l 

However, as in (4.4), one can conclude that 
1 N 

-Y,E[{T% 2 ^-l\^f )u]E[(T^ 2 AJ 1 ^)^^))" 1 !^)*] 

i=l 

For later purpose, we now derive (1.23) and (1.24). Note that when T^r = 
I, for z£ C+, 

(4-5) z = j-+ ° 

m{z) 1 + m(z) 

and 

(4.6) ± m (z)- - {Z) 



dz 1 — cm 2 (z)/(l + m(z)) 2 

Then for g(x) = x r , 

J_ f ( s cm 3 (z)h 2 (z) 

2ni J 9[Z> 1 - cjm 2 {z)t 2 dH (t) / (1 + tm(z)) 2 

c f(-ym(z) + c/(i + m (zW miz)dm{z) 



dmjz) 



2m J (m(z) + l) 3 

c r (-l/m(z) +c/(l + m(z))) 
2vri 7 (m(z) + l) 2 
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-l/m(z) + c/(l + m(«)_)T dm . . 



2ni J (m(z) + l) 3 

A 

= Vx- u 2 . 

For 1/1, we have 

r c f ((I- c)/c+ 1/(1 + m(z))Y ^ , , 

" 1 = c 2^i + 1)2 (i-(i+2a(*))) 

c i+^- rJ^/ r \ fi-c\ j l 



E 



2m J p^Xj J \ c J (l + m(z)) r -i+ 2 

xE( r + J" 1 )( 1 +m(*))*dTa( a ) 



j=0 

Similarly, 



i y V c / V r - 1 



-2 = C 1+r E 
j=0 



r\ (1 — cy / 2r + 1 — j 



3 J \ c J \ r-1 



For (1.24), we have 



d 

1 ~dz\ 



m(zi) 
1 + m(zi) 



.(-1M( ? ) + C/(1+M(^)))- 
7 (m(zi) + l) 2 — v i; 

= 2vr^£^ 1 ^ 1 " C W2ri-j 



i=o 

Therefore, 



i y V c / V 7- !- 1 



c f f cP 
47r2 7 y 9i( z i)92(z2)-^-^[m(zi)m.(z 2 )h 1 (zi,z 2 )]dz 1 dz2 



ii=Oi 2 =o 



hj \hj \ c / V r i ~ 1 / V r 2 - 1 



5. Proof of Theorem 1.2. Since the truncation process is tedious, it is 
deferred to the Appendix. It may then be assumed that the underlying r.v.'s 
satisfy 

Ev n = 0, E\ V11 \ 2 = 1, \v u \<e N y/N, 
where en is a positive sequence converging to zero. 



20 



G. M. PAN AND W. ZHOU 



Define s k = s k H k s k — a\. Expand (s^R^Sfc) 1 a little bit as follows: 
1 1 s k 



(5.1) 

It follows that 

(5.2) 

where 

and 



s*R fc s fc ai aiS*,R fc s fc 

1 Sk . {skf 



TT + 



ai a? afs^R fc s fe 



A 



k=l 



Pk 
fll 



G± + G2 + G3 + G4, 



01 



k=l 



l l *=1 



'1 fe=1 "1 fc=1 s fc R fc s fc 

We will analyze Gi , G2 , G3 , G4 one by one and, as will be seen, the con- 
tribution from the term G4 is negligible. 

First consider the term G4. Since s^R^Sfc > a 2 s k s k , we have 



\G 4 \ <M(G 4 i + --- + G 4 3), 



where 



and 



A 



Gil = ^pk 



k=l 



s k s k ( SfcRfcSfc - — TrR fc 



K 

Ga2 = ^Pk 
k=l 



s* k s k [ -TrR fc -TrR 



K 

G43 = vk 
k=i 



SfeSfc( — TrR-ai 



By the Holder inequality 

K 



EG&i <Mj2Pk(E(s* k s k - l) 2 ) 1/2 (E( S * k R k s k - ^TrR, 



k=l 



6\ 1/2 



A 



+ MY J PkE 



k=l 



s^R fc s fc -^TVR fc 



o(l). 
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Indeed, it is easy to verify that 

(5-3) E( S * kSk -l) 2 = ±(E\vuf-l) 

and that 

: p m 



(5.4) 



E [sin k s k --TrR fc J < — (E\v u \'E(Tt R 2 f/ 2 + Ev^E TV R|) 



where the constant M is independent of k. Here we use the fact R& < 
MS k S* k + a 2 I. 

Furthermore, it is direct to prove 

1 K 

^ l^Pk\* k S k \ — >0. 
fc=l 

This, together with Theorem 1 of Bai and Silverstein [3], leads to 

G 43 ^ 0. 



In addition, it is also easy to verify that 

Combining the above argument, one can claim that the contribution from 
G4 can be ignored. 

Analyze the term G\ second. Write 

K K K K 

J2p k (s* k s k ) 2 = ^2 Pk (s* k s k - l) 2 + 2^2p k s* k s k - Y,Pk 

k=l k=l k=l k=l 

5.5 

K K 

= J2Pk(st*k - l) 2 + 2TrC - Y,Pk- 

fc=i k=i 



Moreover, 



£^$> fc (s£s fc - l) 2 - E(s* k s k - l) 2 ]^j 

= J2pM(sis k - I) 2 - E( S * k s k - l) 2 ) 2 = o(l), 



k=l 
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using 

(5.6) E(s* k s k - l) 4 = 

So 

if 



X>(s^ fc -1) 2 ^-(£M 4 -1) / xdH(x), 
k=i c J 

and then 

(57) i ^M)w 1 +mc .^ \ 

Third, for the term G2, similar to Gi, 

if 

(5.8) -a 2 1 G 2 = Y,Pk(h)(4sk-l) 2 

fc=i 

if if 

(5.9) +2^p fe (s fe )(s£sjfc - 1) + ^p fc (s fc ). 

A=l k=l 



For the sum in (5.8), we have 



E 



if 

k=l 



fe=i 
0(1), 



where we use (5.6) and 

E{s k ) 2 <E^ S tK k s k -^TTK k ^ + E(JyTrR k - ai } =o(jj), 

which is accomplished by (5.4) and Theorem 1 of Bai and Silverstein [3]. 
Similarly to (5.5), we deduce that 

J2p 2 Msk) 2 = -(E\v u \ 4 -l) I x 2 dH(x) 
k=l c J 

(5.10) 

if 

+ 2TrSP 2 S*-5>! + 0p (l). 
fe=i 

Applying C — p^s^st = the second sum of (5.9) is then equal to 

if if 

a 2 Tr C + Tr C 2 - 01 £ p fc - £ pfKs*) 2 
fc=i fc=i 
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(5.11) =fT 2 TYC + TrC 2 -aiX>fc--(£hi| 4 -l) / x 2 dH( 

k=i c J 



K 



-2TVSP 2 S* + ^pl + 0p (l). 



k=l 



With regard to the first sum of (5.9), its variance will be proved to con- 
verge to zero. Now let us provide more details to the reader: 



(5.12) 
where 

and 



Var (^2p k (s k )(s* k s k - 1)^ = G 2 i + G 22 , 



K 



G 2 i = J2plE[(hMs k - 1) - E(s k Ms k - l)f 



k=l 



K 



G22 = PkiPk 2 E[((s kl ){s* ki s kl - 1) - E(s kl )(s* ki s kl - 1)) 

ki^k 2 



x ((sfe 2 )( s fe 2 s fc 2 - 1) - E (h 2 )(4 2 s k 2 - I))]- 



Evidently, 



A' 



G 2 i<^2ME[(s k Ms k -l)f 

k=l 



A 



<mJ2 e 

k=l 

K 



s* fc R fc s fc --TrR fc )(s* fc s fc -l) 



(5.13) 



k=l 



N 



TtRfc-ai Ws fc -1) 



n 2 



A 



< 



my: 

k=i 



1 



E stRfcSfc- — Ti:R fc 



N 



1/2 



[£(s* fc S, - l) 4 ] 1 ^ 



A 



fc=l 



+ M ^sj-TrRfc-ax) E(s%s k -1) 



o(l). 



Let 

Sfcifc 2 denote the matrix obtained from S kl by deleting the A^th column 
and, furthermore, ~R klk2 and C klk2 have the same meaning. Split R^ 1 = 
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Rfcifca +Pk2 s k 2 s *k 2 and R ^2 = R -fc 1 fc 2 +Pfci s fei s fci- Also > for convenience, set 



and 



a kj — s^.RfofcjSj^ - ai, 7j — s^.Rfc^Sjy - — Tr R fcl ^ 2 



T /y = s *k j s k j ~ 1, J = 1,2. 



G22 is then decomposed as 

G22 = G221 H h G224, 



where 



A' 



G221 = X! PfciPfc 2 Cov(a fcl T fcl ,afc 2 ^fe 2 ), 



A 



C 2 22 = 51 PfcjPfe Cov(a fcl T fcl , |s^s te | 2 T fe2 ; 



A 



G 22 3 = J2 PkiPk 2 Cov(\s* ki s k2 \ 2 T kl ,a k2 T k2 ) 

ki^k 2 



and 



A 



G 22 4 = ^fciA Cov(|s^ 1 s fc2 | 2 X fcl , |s^. 1 s A . 2 | 2 X A . 2 ). 

kx^k 2 

The basic idea behind this decomposition is to produce some independent 
terms when Ti, klk2 is given, which is very important when estimating the 
order of some terms. 
It is easy to check that 



s* fc R fc s fc -lTYR fc 



E\v u \ 4 -1 

AT2 



ETrHi 



and that 



(5.15) E 



s^D Sl --TrD 



1 N 1 

^(i^-2)]T[(D^ 2 + ^TrDD* 



i=l 



where D is any constant Hermite matrix. 
This gives that G221 is equal to 



A 



Pk 1 Pk 2 E[E(a kl T kl I K klk2 )E(a k2 T k2 | R fclfe2 )] 

fci^fc 2 
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A 



fcl^fc 2 



^-1 



J ll 

N 



k\k 2 



where a fc T fc = a k T k - Ea k T k , 7 fc T fc = ^ k T k - E^ k T k , and we use the inde- 
pendence of s kl and s k2 , and 

2 



1 



1 



E[ — TrK klk2 -E— TrR fclfe , ] = — £ 



1 



AT2' 



(5.16) 

where M is independent of fei , fc 2 • 

After some simple computations, we get 

£M 4 -i 



E Pjipfa-i) 

j^kifa 



< 



M 
iV 2 "' 



(5.17) 



E \ s k 1 s k 2 \ 2 Tk2 



E{\s* kl s k2 \ 2 l: k2 | s fel ) = '"^ 2 — 1 Sfc 1 s fel 



AT2 

£hil 4 -i 



and so 



A' 



G 222 = £ pi, 1 p fc2 S((a fcl T fel )^[|s^ i s fc2 | 2 T fc2 -ii;(|s* fci s fc2 | 2 T fc2 )|s fcl ]) 



#M 4 -i 



AT2 



£ 4iP*a(- B [( a fci T fci) s fci s *i]+ £? ( a fci T *i)) 



(5.18) 



^kul 4 - 1 



M 



AT2 



A 



E j4?*i £ [( a *i T »i) T *i] 



k\i=-k 2 



Similarly, one can conclude that 
(5.19) G 223 ^0. 

Write 

K K 

c 224 = E plAM^^k^k,]- E plplM\ s >k 2 \ 2 r kl )} 2 . 



ki^k 2 



ki^k 2 
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The second sum converges to zero because of (5.17). For its first sum we 
have 

K K 

J2 ^ij4- E7 s fci s *a| 4T *i T fe«] = PkrP^Ei^^EM^^Tk, | S fc2 ]}, 

fcl^fe k^k 2 

which is less than or equal to 

K 



(5.20) 



M E\\T k2 \E 

k\^k 2 



K r 
+ m J2 E{\r k2 \E 



ki^=k 2 



AT 



s k 2 s k 2 iTfcJ | s fc2 



o(l), 



as 



E\\T k2 \E 



Sfci S fc 2 s fe s fei - ^ Trs fc2 S fc 2 ) l T fcil I Sfc 2 



<£ |T fc2 | 



Me 2 N 



E [ [ s* kl Sfc 2 Sfc 2 s fcl - — TV s fc2 s£ 2 ) | s fe 



1/2 



[E(? 2 kl I s fe )] 1/2 



^^^|Tfe|(SfeS^ 
Mr 



^^[|T fc2 | 3 ] + ^|(^ 2 )V 2 
1 



and 



1 \ 2 

jj s k 2 s k 2 J |T fcl | | s fc2 



<^[|T* a |K«»*.) a ](^|T* 1 | 2 ) 1/a = o(^)- 

Consequently, G224 converges to zero and then G22 converges to zero. There- 
fore, via (5.14), 



A 



(5.21) 



J2Pk(s k )(s* k Sk - 1) 
fc=l 



i.p. £hll 4 -l 



ai / xdH(x). 



Combining (5.9)-(5.12) with (5.21), one can conclude that 



1a x 



£M 4 -l 



x dH(x) 
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(5.22) 



K 

+ <T 2 TrC + TYC 2 -ai5> fc 

k=l 

_ l(E\v n \ 4 -1) 
c 



/ x 2 dfl-(x) - 2 Tr SP 2 S* + ^ p\ 

J k=l 



+ Op(l). 



Fourth, turn to the term G3. It is decomposed as 
(5.23) afG 3 = G 31 +G 32 + G 33 , 

where 



A* 



G 3 i = £p fe (s£s fe -l) 2 (s fe ) s 
fc=i 



(recall s k = s^R^Sfc — a\) and 



K K 

G 32 = 2^2p k (s* k s k - l)(s fc ) 2 , G 33 = ^Pfc(s fc ) 2 . 
fc=i fc=i 



Applying the Holder inequality, 

K 



E\G 31 \<MJ2 



k=l 



K 



E( S * k s k -l) 2 s£R fc s fc --TrR, 



N 



+ E(s* kSk -iy(-TrR k - ai 



< MjT(E(s* k s k - l) 4 ) 1/2 (£(4R fc s fc - ^ItR*) ) 



4 \ V 2 



A* 



+ M^£(s£s fc -l) 2 £(^TrR fc -a 1 ) = o(l). 

fc=i 



Analogously, one can also obtain 

E\G 32 \=o{\). 

To derive the limit of G33, we need to evaluate its variance: 
(5.24) E^pl[{s k f - E{~s k f]^ =G 331 + G 332 , 
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where 

K 

\2l2 



G 331 = ^2ptE[(s k ) 2 -E(s k f 
k=l 



and 

K 



G 332 = E ^^^[((^J'-^fcJ^lfe) 2 -^) 2 ) 



fcl^fc 2 
For G331 , we have 

K 



G 331 <Mj2E[(hY 



k=l 

< M E (si R fc s fc - 1 Tr R fc ) * + M £ E ( ±- Tr R^ - 1 Tr R 

k=i ^ ' k=i ^ 

K , x 



+ MY,El y -TrR-a 1 ) =o(l). 



In fact, note that ai = cr 2 + — , 



1 * 



(5.25) ^-TrR- ai j = E ^- ^p k (s%s k - 1) j =°(^J- 

Since the treatment of G332 is basically similar to that of G22, we give 
only an outline. To this end, we expand it as 

(5.26) G332 = G332 H h G332, 



where 



K 

G 332 = X PkiPk 2 Cov(a 2 kl ,a> 2 k2 ), 

kx^k 2 
K 

G 332 = S PilPfc2 Cov ( a LKi S fc2| 4 )> 

G §2 = 2 X Pfc 1 Pfc2 Cov (afc 1) afe2l s fc 1 s fc 2 | 2 ) 5 
fel^fc 2 

G 332 = 2 X) Pfcil4 Cov ( a *il s fci s *a| 2 ' a *a)' 
fci^fc 2 



CLT FOR SIR 



29 



K 



G 332 = 2 E PfciW2Cov(a fcl |s^s fe2 | 2 ,|s^s fc2 | 4 ), 

k\^k 2 



A* 



G 332 = 4 E ^i^3 Cov ( a fcil 8 *i s fca| 2 iOfcal s fci 8 fc: 

fcl^fc2 



2I 2 ), 



G 



(7) 
332 



A 



E PkiPk 2 Cov(\s* ki s k2 \ A ,a 

k\^k 2 



G 3 32 = 2 E Pi^Vards^ 



A 



and 



fei^fe 2 



A 



G 332 = 2 E ^Pfca^d 8 *! 8 ^! 4 ' ^! 8 *! 8 ^! 2 ) 



We claim that 



G332 = o(l). 



But, in the sequel, as an illustration, only terms G332 and G332 will be 
estimated, the argument for all the remaining ones are analogous and then 
omitted. 

Using the Burkholder inequality, 

4 N 



m^k 2 f< 



(5.27) 



M 
O 



- 1 N \ 4 AT 

Ai=l / i=l 



which leads to 



1 

A 



\G ( sJ 2 \<M E pl lP l 2 E\s* ki s k2 \ 8 = 

k\j=-k 2 



From (5.15), 



K 



^332 — E PkiPk 2 E[E(al 1 - Ea 2 kl \ B, klk2 )E(a\ 2 - Ea\ 2 | R^fo)] 



- AT4 



ki^k 2 



E{TrBl ik2 - ETTB? kik2 f + E{TrK klk2 - N ai Y 
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(5-28) +E^2[CR klk2 ) ii } 2 -E[(R klk2 ) u A 

+ (E(TrK klk2 -N ai ) 2 ) 2 
= o(l). 

In order to get (5.28), we need to analyze the above four terms on the right- 
hand side of the inequality. First, applying Rjt 1 jfc 2 = (Rfc^ — Rfci) + Rfci 
twice, we have 

£(TrRl lfc2 -£TrR| ifc2 ) 2 

< M£(Tr(R fclfc2 - R fcl )R fclfc2 - ETr(R klk2 - R kl )K klk2 f 
+ ME(Tr~R, kl (Rfofcjj — RfcJ - ETrH kl (R klk2 - Rfa)) 2 

(5.29) 

+ M£(TrR 2 , i -£TrRl i ) 2 

< ME{% 2 f + ME{{s% 2 s k2 f - E(s* k2 s k2 f) 2 
+ Af£(TrR 2 i -£TrR 2 i ) 2 , 

where ^ k2 = s* k2 H klk2 s k2 — jfETr~R klk2 . However, observe that 

1 



(5.30) E((sl 2 s k2 r-E(s* k2 s k2 yf = 

and that 



N 



E( lk2 ) 2 <—, 



M 
~N 

using (5.4) and (5.16). Therefore, 

^(TrRU " ETrR 2 kik2 ) 2 < ^ + ME (TrR^ - ETrK 2 ki ) 2 

< — + ME(TtK 2 - ETtB 2 ) 2 

again, repeating a process analogous to (5.29) in the last step. But this 
implies 

M K 

w E(TrR 2 klk2 -ETvR 2 klk2 ) 2 ^0. 

Second, 

^4 



E(Tr-R klk2 -NaxY 



< ME 



K 



^p fc (s^s fc -l) 

k=l 



+ M£(4 iStl ) 4 + Mi?(4 2 s b ) 4 < M, 
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which shows that the second sum in (5.28) converges to zero. Similarly, one 
can also prove that the fourth sum in (5.28) converges to zero by a similar 
argument, as expected. Finally, in order to show that the third sum in (5.28) 
converges to zero, it is enough to show that 

E\[(CU 2 -E[(CU 2 \ 2 ^0. 

To this end, it suffices to verify that 

E|(C)«-.E(C)«| 4 ->0, 

but, as in Theorem 1.3, through martingale difference decomposition, one 
can get it. Thus, (5.28) holds. 

Hence, by (5.15) and an argument similar to Theorem 1.4, we have so far 
proved that 

G33 = — — + a\ / xdH(x) + o p 1 

c c J 

and then 

(5.31) G 3 = -^(a 2 + (E\ Vll \ A -2)a 2 ) [ x dH(x) + o p (l). 

Summarizing (5.7), (5.22) and (5.31), we conclude that 



k=l 



(5.32) 



— TrC- iTrC 2 + 4TrSP 2 S'' 



2 / 2 1 2 



nt^ of f-i Vco? caiJ J 



+ E \ Vll \ 2 ~ l [ x 2 m ^ + 

(recall that a\ = a 2 + 1/c). 

Now we let pt = 1, k = 1, . . . , K, so that Theorem 1.4 can be applied. In 
this case (5.32) becomes 



E (fik - = 2 + 2 ^ + ^ C& c - g) - (Tr C 2 - (1 + 1/c) jo 



fc=l 



(5.33) 

i , ^hi| 4 -i 



cav cat 
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[a 2 = ( 1+1 / c ) + cr 4 + 2<7 2 /c]. Then Theorem 1.3 follows from Theorem 1.4. 
The expectation and variance of the limiting normal distribution are also 
from (1.23) and (1.24) of Bai and Silverstein [3] and our (1.23) and (1.24). 
Therefore, the variance r 2 is equal to 

(2 + 2/c + a 2 )\E\v 11 \ t -l) 



(5.34) 



c(a 2 + l/c) 4 

n (2 + 2/c + (i 2 )(2c + 2) 
c 2 (a 2 + l/c) 4 



(£M 4 -i) 



-I (4c 3 + 10c 2 + 4c 

c 4 (a 2 + l/c) 41 + + 



+ (4c 3 + 8c 2 + 4c)(£M 4 -2)). 
6. Proof of Corollary 1.1. By the Taylor expansion, 

K 



XViog(i + /3 fc )-iog(i + - 

k=l V V «i 



K 



^ l + l/oi ~ fc tl 2(1 + l/a 1 ) 2+ ^ 1 3(1 + ^)3 



with ^ being located in the interval [l/ai,/3fc]. Similar to Theorem 1.3, it 
can be shown that 

E (±(fa-i) 2 -^-i) 2 )) 2 =°m 



\k=l 



and 



\{(i k - l/«i) 3 l l^ 3 



£l 3(1 + ^) 3 " h 



K 

Ol 



0. 



Now compute £f =1 £(/? fc - ^) 2 - Applying (5.1), 
(6.1) £ E f A -i) 2 = f B(<&t±- *S* + ^' 



Again, via an argument analogous to Theorem 1.3, it is easily seen that 
the contribution from the terms involving (SfcSfc) 2 (sfc) 2 /(afs£RfcSfc) can be 
ignored. So (6.1) is equal to 

g2?( (s * fcSfc)2 " 1 ) 2 I j^E f{slSk?{§k) ' 
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_ 2 f ^(W-iWW^d, 

fc=l fll fl l 

Combining the argument of Theorem 1.3 with (5.15) and (5.14), the above 
three terms are equal to, respectively, 4(.E|vn| 4 — l)/(caf), (a2 + £ , |t;ii| 4 — 
2)/(ca 4 ) and -A(E\vn\ 4 - l)/(ca\). Thus, we finish the proof. 

APPENDIX: TRUNCATION OF UNDERLYING RANDOM 
VARIABLES IN THEOREM 1.3 

Let Vij = Vijl(\vij\ < e n VN) and % = i = 1, . . . , N, j = 1, . . . , K, 

where en is a positive sequence converging to zero. We use Sfc,ifc, 
Rfe, Rfc and (5k, Pk, k = 1, . . . , K, to denote the analogues of s^, and 
/3fe with the elements replaced by or . 

As in the proof for Theorem 1.3 in Pan, Guo and Zhou [12], one can select 
the above £jy so that 



and show that 



^ - 
fc=i fe=i 

Now consider the re-centralization of random variables. Applying (5.1), 



(A.l) Y, M * lh)2 =Ui + U 2 + U 3 + U 4 , 



where 

K 



«i fc= i a i fc= i s fe R fcSfc 



and 



1 * 



^2 = — 2^pi;(sp)tf(^R fc Si-ai) 



°i fc=i 
1 * 



^3 = ^y2Pk(sth) 2 (s*k&kSk - ai) 

rt ,J • ■ 



a i fc=i 

In the sequel we shall show that U4 converges to zero in probability. Note 
that 
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This gives 



K 

\Ua\ <M^s^s fc |s^R fc s fc -ai| 3 

k=l 
K 

(A.2) < M (SfeSfc + Sfc^Sfc + (Es* k )s k + £s££s fc ) 

k=l 



x |sfcR fc s fc - 01 + s* k K k Es k + (^Sfe)R fe s & + (Es* k )R k Es k \ 3 . 

Then we need to compute each term of the above expansion. 
It is observed that 
/ K 



(A.3) £s* fe s fe 



\k=l 



Sfe^fcSfc - TrR fe 



K 



\k=l 



N 



s^R fc s fc - — TrR fc 



+ \s* k (ES k )P k S* k s k \ 3 



(A.4) 



+ \s* k S k P k (ESl)s k \ 3 + \st(ES k )P k (ESt)s k ^ 



It is a simple matter to prove that 



lim E(v n ) 2 = 1. 

N— >oo 



Then, appealing (5.4), we have 
/ if 



(A.5) 



vA=l 



SfcR fc s fc - -^TrR fc 



fe=i 



6\ 1/2 



For the first term in (A.4), with the notation e= ^=(1, . . . , 1)* and G 
S k P k (ES* k )(ES k )P k St, analogously, 

E(j2 slskKS k P k (ESl)- Sk A 



\k=l 



<me[J2^ 

\k=l 



1 



+ ME(j2spk 



s fcSfcPfe(£'Sfc)s fc - — TrSfcPjfc£'S fc 
1 



fc=i 



N 



TtS k P k ES* k 



N 

3 N 
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M 



k=l 



<^E ( E (^G) +£-Tr(G) 



N 



N 



1/2 



/ 1 \ 3/2 

E(-TrG) + £-Tr(G) 3 / 2 



+ M 



{Evii) 
N 3 



N 



3 / K 



N 



J2 E 

\k=l 



0(1). 



Indeed, 



(EvnffrE^PjS-e ) <M(Ev u ) 3 KNV 2 =o^ 



and since 



we have 



G < MN(Evu) 2 S k ee*ee*S* k , 



E — TYG <MN 3 (Evn) 6 E — TrSiSJ 



iV 



AT 



The other terms can be estimated similarly. Regarding the last term in (A. 4), 
we have 

K K , 

]Tspi fc |s;U£S fc )P fc (i^ 

k=l k=l 

where || • || denotes the spectral norm of a matrix. Therefore, (A. 3) converges 
to zero in probability. 
Now 

K -, 3 



k=l 



■^TvR k - ai 



K 



(A.6) 



k=i 



N 



TrR k - ai 



+ 



N 



:TrS fe P fc £S£ 



+ 



Tr(£S fc )P fe S£ 



+ 



N 



TrES k P k ES* k 



For its first term one can get 

K 3 K 



Ej2*tsk 

k=l 



TrR k - oi 



<Mj2(E(r k - Sk -if) 1/2 (E 

k=l 



N 



Triifc - oi 



6\ 1/2 



K 



k=l 



Tr R k - a\ 



o(l), 
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as 



E 



— TrR k -ai 



E 



K 



o 



Np/ 2 



The argument that the remaining terms of (A. 6) converge to zero in prob- 
ability is similar to above, even simpler and then omitted. Hence, (A. 6) 
converges to zero in probability. This, together with (A. 3), leads to 



K 



(A.7) 



s^SfelSfcKfcSfe - ai| — > 0, 



fc=i 



which is one term in (A. 2). All remaining items of (A. 2) can be computed 
similarly, so we omit it here. Consequently, 



U 4 ^0 



and 
(A.8 



A* 



j2^>iL = u 1 + u 2 + u 3 + o p (i). 
k=i s fcR-fcS/c 



Analogously, one can also show that 

K 

(A.9) 
where 



^l+^2 + ^3 + O p (l), 



1 K 1 K 

Vi = — ^2pk(st s k) 2 , v 2 = — 2Ewfe) 2 (4 R ^- a i) 



k=i 



l i k=i 



and 



K 



l i k=i 

In the following, we show that Ui — Vi,i = 1,2,3, converge to zero in proba- 
bility Since all the calculations for Ui — Vi are similar, as an illustration, we 
consider U2 — V2 only. 
Write 



(A.10) 
where 



a\{U 2 -V 2 ) = U 21 + U 22 , 



K 



U 2 1 = J2Pk((s*kh) 2 ~ (SfcSfc) 2 )(s£R fc Sfc - 01) 

k=l 
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and 

K 

U22 = ^p k (s* k s k ) 2 (s* k Tl k s k - SfcR fc s fc ). 
k=l 

Furthermore, expand U21 as follows: 
K 

U21 = J2Pk((s* k Eh) 2 + ((Es* k )s k ) 2 + (Es* k Es k ) 2 + 2s£s fc s££s fe 
fc=i 

+ 2s* k s k (Es* k )s k + 2sl(Es k )(Es* k )s k + 2s* k s k Es* k Es k 
+ 2(Es* k )s k (Es* k )Es k + 2s* k Es k Es* k Es k ) 
x (sfcR fc s fc -ai), 

which can be easily proved to tend to zero in probability. For example, for 
one of the terms, 



E 



K 

^Pksts k s k {Es k )(s k t 'R k s k - ai) 

k=l 



K 



< y/Ne N Ev n Y,( E (^) 2 ) 1/2 (E(s* k fi k s k - ai ) 2 ) 1/2 = o 

k=l 

For U22, we have 

K 

U22 < ^p k (sls k ) 2 (slK k s k -slK k s k + slIL k Es k 
k=i 

(A.ll) 

+ (Es* k )R, k s k + (Es* k )-R k (Es k )). 

Moreover, it is observed that 

A 



^2Pk(s*kSk) 2 (SkR-kS k - S* k H k S k ) 



k=l 

K 



(A.12) =J2Pk(s%s k f 



'Jk{*k^ 2 

k=l 

x (s* k S k P k (ES* k )s k + s* k (ES k )P k S* k s k + s* k (ES k )P k {ES* k )s k ). 
As for the first sum of the above expansion, 



E 



K 

J2Pk(sts k ) 2 s* k S k P k (ESl)s k 

k=l 
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< M^(^it) 4 ) 1/2 (^( s* k S k P k (ES* k )s k -±TrS k P k ES* k Y) 1/2 



K 

E 

fe=i 



+ E 

k=l 

where we make use of 



K 



J2Pk(*lsk) 2 W TrS k P k ES 



M 



E(s* k s k T < ME(s* k s k - E(s* k s k )) + M(E(sls k )T < + M 



N 



and 



El s* k S k P k (ES* k )s k - -TrS k P k ES* k < Tr ESlES k E(S* k S k 



N 



M 



< 



N 2 
M||£S fc || 2 

TV 1 



ETrS k S k =o 



1 

AT3 



and 



E 



K 



J2Pk(s* k s k ) 2 ^TrS k P k ES 



k=l 



ATl/2 



Similarly, one can also verify that the other two terms of (A. 12) converge 
to zero in probability, and all the other items of (A. 11) converge to zero in 

i.p. i.p. 

probability. So U22 —> 0, and then U2 — V2 — 0, as expected. Finally, we 
get 



K K 
k=l k=l 



0. 



Similarly, one can perform the re-normalization step, but it is omitted here. 
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